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Presentation  Highlights 


■  Computational  programming  demands  continue  to  increase 
at  a  rapid  pace  despite  technological  challenges  and 
limitations 

■  Parallelism  is  the  [new]  principal  method  for  increasing  and 
improving  processor  performance 

■  Dataflow  programming  languages  address  several  barriers 
associated  with  parallel  programming 

■  Dataflow  languages  ought  to  be  considered  along  with 
traditional  (imperative)  programming  solutions 


Email  garth.black@ni.com  with  questions 
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Programming  Demands  and 
Limitations 


■  Rising  demand  for  faster  execution  and 
increasingly  complex  programming 

■  Clock  frequency  (speed)  is  trending  to  an 
asymptotic  condition  (3  GHz) 

■  Moore's  Law  may  still  be  valid,  but  the  Law  of 
Thermodynamics  is  also  valid 

■  Parallel  Programming  options  exist,  but  can 
be  complicated 


Just  increase  Clock  Frequency? 


■  Old  (Conventional  Wisdom) 

■  Increasing  clock  frequency  is  the  primary  method 
of  improving  processor  performance. 

■  New  [conventional  wisdom]: 

■  Increasing  parallelism  is  the  primary  method  of 
improving  processor  performance. 

■  "Even  representatives  from  Intel  warned  that 
traditional  approaches  to  maximizing 
performance  through  maximizing  clock 
speed  have  been  pushed  to  their  limit." 


Asanovic,  Krste  etal.  (December  i8,  2006).  'The  Landscape  of  Parallel  Computing 
Research:  A  View  from  Berkeley  (PDF).  University  of  California,  Berkeley.  Technical 
Report  No.  UCB/EECS-2006-183. 
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The  Human  Parallel  Processor 


■  Billions  of  Nerve  Cells 
(Neurons) 

■  Networks  of  neurons 
form  massive  parallel 
processing  system 

■  Parallelism:  Vision, 
Hearing,  Motion 


Image  courtesy  of  Wikipedia 


"Massive"  CPU  Parallel  Processor 


■  "Massively  Parallel  Processor" 

■  A  cabinet  from  Blue  Gene/L, 
ranked  as  the  fourth  fastest 
supercomputer  in  the  world. 

■  More  than  100  CPUs  with 
high  speed  interconnect 

■  Analogous  to  Human  Brain 


How  do  we  program  Parallel 
Processes? 


■  Newsweek  Article 

(Moore's  Law  Doesn't  Matter ;  August  15,  2009) 

■  Imperative  vs.  Dataflow  programming 


Imperative  Programming  vs. 
Dataflow  Programmaing 


■  Imperative  programming  is  modeled  as  a 
series  of  operations,  the  data  paths  between 
operations  being  effectively  invisible 

■  Examples:  C/C++,  Fortran,  Pascal 

■  Dataflow  programming  explicitly  illustrates 
the  "flow  of  data"  between  program 
operations 

■  Examples:  SISAL,  SAC,  LabVIEW,  VEE 
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Contrast:  Imperative  Programming 
vs.  Dataflow  Programming 


Imperative  Language 


Dataflow  Language 


Line  i:  x  =  5 
Line  2:  y  =  x  + 1 
Line  3:  z  =  y  *  3 


y  *  3  ">  z 
x  +  1  ->  y 

5->x 


Rules 
Input  Data 


Execute  each  statement 
in  order. 


Identify  all  rules  and 
then  provide  inputs. 


The  compiler  determines  that  y 
needs  to  be  calculated  before  z. 


Contrast:  Imperative  Programming 
vs.  Dataflow  Programming 


Imperative  Language 


Dataflow  Language 


Line  i:  x  =  5 
Line  2:  y  =  x  + 1 
Line  3:  z  =  y  *  3 


x  +  1  ->  y 
y  *3->z 

5->x 


Rules 
Input  Data 


Execute  each  statement 
in  order. 


Identify  all  rules  and 
then  provide  inputs. 


The  exact  order  of  rule  statements  is 
not  important  in  dataflow  code! 
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Dataflow  Programming  correlates 
to  standard  flowchart  models 


Flowchart 


Dataflow  Program 


1st  art  |  |read  temp|  |compare|  Idisplay  (PRINT)  answer]  |end| 


Example:  A  flow  chart  represents  the  relationships  between  inputs  and  outputs.  Dataflow 

programming  uses  the  same  "flow"  paradigm. 


11 


Dataflow  Languages  are  Naturally 
Expressed  Graphically 


Formula:  Result  =  (A+B*C)  /  (D-E) 
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Dataflow  Languages  Enable 
Automatic  Parallelization 


Both  the  multiply/add  and  subtract  operations  can  execute  at  the  same  time 
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Dataflow  Languages  Naturally 
Express  Parallel  Applications 


Filter 


Unfiltered  Signal 

Filtered  Signal 

Hl 

Frequency  Domain  Signal 


Time  Domain  Signal 


Task  Parallelism 
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Dataflow  Languages  Naturally 
Express  Parallel  Applications 


Data  Parallelism 
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Sequential  Operations 
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Parallel  Computing:  Pipelining 
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Parallel  Operations  on  Multiple 
CPUs 


CPU  #3 


CPU  #2 


CPU  #4 
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Dataflow  Languages  are  Actively 
Used  in  Academia  and  Industry 


■  Academic  Efforts 

■  SISAL  (University  of  Manchester  &  Colorado  State) 

■  LUSTRE  (University  ofVictoria) 

■  Commercial  Products  and  Standards 

■  VHDL  (based  on  IEEE  standards) 

■  National  Instruments  LabVIEW 

■  Agilent  VEE 

■  Northwoods  Software  Sanscript 

■  Many  others... 
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Outside  the  CPU  sphere:  Other 
Parallel  Hardware  Targets 


■  Market  is  demanding  smaller,  cheaper,  faster  targets 

■  FPGAs,  DSPs,  Embedded  Real-time  products 

■  Programmable  hardware  targets  are  converging 
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Advantages  and  Caveats  of 
Dataflow  Languages 


Caveats 

Advantages 

Typically  no  by-reference 
data  accesses 
(by-value  only) 

Can  be  automatically  be 
mapped  to  parallel  hardware 
including  multicore  CPUs 

Some  overhead  due  to  run¬ 
time  scheduler 
(if  present) 

Naturally  expressed 
graphically;  can  improve 
productivity 

Different  paradigm  from 
imperative  languages: 
requires  a  learning  curve 

May  reduce  the  need  for 
multiple  development  tools 
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Conclusions 


□  Increasingly  parallel  embedded  hardware  warrants 
new  methods  of  parallel  software  development 


□  Dataflow  languages  can  address  some  major 
challenges  associated  with  parallel  programming 

□  Many  dataflow  languages  exist  today,  and  should  be 
considered  along  with  other  programming  solutions 


Email  garth.black@ni.com  with  questions 
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Nl  Support  at  HAFB 


■  Skilled  engineering  &  developer  support.  Current 
work  includes: 

■  Solar  Radiometer  System  (Embedded  Real-time) 

■  EFV  (Expeditionary  Fighting  Vehicle) 

■  CBATS  Test  Platform 

■  Metrology  Lab 

■  Base  Contractor's  Badge 

■  Familiarity  and  history  with  base  operation 

■  WeeklyVisits 

■  Complimentary  -  quarterly  training  sessions 
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ThankYou 
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How  to  contact  me? 


Garth  Black 

Field  Engineering  Manager 
N.  Utah  &E.  Idaho 

Phone:  (801)  447-3343 
E-mail:  qarth.black@ni.com 
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